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The law of the iterated logarithm in 
game-theoretic probability with quadratic and 
stronger hedges 

Kenshi Miyabe* and Akimichi Takemura^ 
August 25, 2012 

Abstract 

We prove both the validity and the sharpness of the law of the iter- 
ated logarithm in game-theoretic probability with quadratic and stronger 
hedges. 

1 Background and the main result 

The law of the iterated logarithm (LIL) in game-theoretic probability was stud- 
ied in Shafer and Vovk [8] under two protocols. The first protocol "unbounded 
forecasting" only contains a quadratic hedge. 

Unbounded Forecasting 
Players: Forecaster, Skeptic, Reality 
Protocol: 
/Co := 1. 

FOR n — 1,2,...: 

Forecaster announces m n £ K and v n > 0. 
Skeptic announces M n £ K and V n > 0. 
Reality announces i„6l. 

K n := /C„_! + M n {x n - m„) + V n ((x n - m n ) 2 - v n ). 
Collateral Duties: Skeptic must keep IC n non-negative. Reality 
must keep JC n from tending to infinity. 

When Forecaster announces the range of x n at each round n, the game is 
called "predictably unbounded forecasting" . 

Predictably Unbounded Forecasting 
Players: Forecaster, Skeptic, Reality 
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Protocol: 

/Co := 1. 

FOR n = 1,2,...: 

Forecaster announces m n € R, c„ > 0, and v n > 0. 

Skeptic announces M„ € R and V n > 0. 

Reality announces i„ € R such that |jc n — m n \ < c„. 

/C„ := /C n _i + M n (a: n - m n ) + V n {(x n - m n ) 2 - v n ). 
Collateral Duties: Skeptic must keep K. n non-negative. Reality 
must keep /C„ from tending to infinity. 

Let A n = X)2=i v i- Shafer and Vovk [5] showed the following two theorems. 

Theorem 1.1 (Theorem 5.1 in [8 ). In the predictably unbounded forecasting 
protocol, Skeptic can force 




> W lnln,4 n // V2A„lnlnA„ 

Theorem 1.2 (Theorem 5.2 in 0). In f/ie unbounded forecasting protocol, Skep- 
tic can force 



[ A n -> oo & |x„ -m„| = o ] =► limsup^ 1 ^, ^ < 1. 

In the unbounded forecasting protocol, it seems difficult to give a natural 
sufficient condition to force the lower bound of the LIL (cf. Proposition 5.1 
of [5]). Then we would like to find a non-predictable protocol under which a 
natural sufficient condition for the LIL exists. A clue can be found in Takazawa 
PHHH] where he has showed a weaker upper bound with double hedges. Another 
clue is the original proof [2] of the Hartman-Wintner LIL that uses a delicate 
truncation (see also Petrov [5]). Thus we consider a game with stronger hedges 
large enough to do the truncation. 

The Unbounded Forecasting Game With Quadratic and 
Stronger Hedges (UFQSH) 
Parameter: h : R -> M 
Players: Forecaster, Skeptic, Reality 
Protocol: 
/Co := 1. 

FOR n = 1,2,...: 

Forecaster announces m n £ R, v n > and w n > 0. 
Skeptic announces M n £ R, V n € R and W n > 0. 
Reality announces i„el. 

K, n := /C„_x + M n (x n - m n ) + V n ((x n - m n ) 2 - v n ) 
+W n (h(x n ~ m n ) - w„). 
Collateral Duties: Skeptic must keep JC n non-negative. Reality 
must keep K n from tending to infinity. Forecaster must keep the 
game coherent. 
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For simplicity we only consider an extra hedge h with the following condi- 
tions. 

Assumption 1.3. 

(i) h is an even function. 

(ii) h£C 2 and h(0) = ft'(O) = h"(0) = 0. 

(iii) h"(x) is strictly increasing, unbounded and concave (upward convex) for 
x>0. 

Let 



e -V T . h An 



, lnlnA n 

i—i 

We state our main result. 
Theorem 1.4. In UFQSH with h satisfying Assumvtion M.SX Skeptic can force 

A n — y oo and > - - , < oo hmsup . = 1. 

\ V^M J n^oo V2A„lnlnA„ 

This theorem is a consequence of Proposition ^. 51 (upper bound, validity) and 
Proposition ^ . 71 (lower bound, sharpness) below. This theorem has the following 
corollary. 

Corollary 1.5. Let h be an extra hedge satisfying Assumption ] l.SH and 

V 1 <oo. (1) 

~ h(yjn/ In Inn) 

In UFQSH with this h and m n = m, v n = v and w n = w, the following are 
equivalent for ra'€l and v' > 0. 

(i) m! = m and v' — v. 

(ii) Skeptic can force 

limsup " = = VV. (2) 
n-s-oo V2rilnlnn 

(iii) Reality can comply with (U). 

The definition of "comply" is given in Definition 12.111 
Remark 1.6. The equation ^ can be replaced with 

,. . £ S n - m'n 
limmt — = 

n ^°° \j2n In Inn 
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Examples for h in this case are h(x) = \x\ a , 2 < a < 3, and h(x) = 
(x + l) 2 In 2 (a; + 1) - x 2 . See Example [231 and Example 1211 below. 

We review some related results. The LIL was proved in Kolmogorov [3] 
under the condition of \x n \ = o(yM„/ln In A n ). Marcinkiewicz and Zygmund 
[4 constructed a sequence of independent random variables for which A n — > oo 
and \x n \ — 0(y/ A n / In In A n ) and which does not obey the LIL. A number of 
other sufficient conditions for Kolmogorov's LIL were given in the literature 
such as [TJ [7]. In an important case of independent, identically distributed 
(i.i.d.) random variables, Hartman and Wintner [2] proved that existence of 
a second moment suffices for the LIL and Strassen [9] proved conversely that 
existence of a second moment is necessary. 

A game-theoretic version of Kolmogorov's LIL was established by Shafer 
and Vovk [8], in which a game-theoretic version of Hartman- Wintner's LIL was 
questioned. As we stated, Takazawa [TUl H] also obtained some related results. 
Our main result gives a sufficient condition for game-theoretic Kolmogorov's 
LIL with an extra hedge slightly stronger than the quadratic one. The corollary 
has a similar form as Hartman- Wintner's LIL and Strassen's converse although 
stronger hedges are assumed in our case. 

2 Facts and proofs 

In this section we give a proof of our main theorem and its corollary. For 
readability our proof is divided into several sections. We also prove some facts 
of independent interest. 

2.1 Consequences of the assumptions on the extra hedge 

From now on we assume m n = without loss of generality until Section [2.61 
Proposition 2.1. Under Assumvtion \1.3[ we have 

(i) lim^o = and lim x ^ ^ = 0. 

(ii) hJ2l is strictly increasing and unbounded for x > 0. 

(iii) For < c < 1 and for x > we have 

c 3 h{x) < h{cx) < c 2 h{x). 

For c > 1 and for x > 

c 2 h{x) < h{cx) < c 3 h{x). 

(iv) x 2 — o(h(x)). 

(v) h(x) = 0(x 3 ). 

(vi) For any b > 0, max y > (l + y + y 2 /2 - h(by)/h(b)) < 2. 
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Proof, (i) Since h"(0) = and h" is continuous, for each e > 0, there exists 
8 > such that 

h"{x) < e for < x < S. 

Then 

f-X f-X 

h'(x) = / h"(t)dt < edt = ex. 
Jo Jo 

Thus lim^^o h'(x)/x — 0. By a similar way, we can show that lim^^o = 0. 

(ii) The strict monotonicity of h'(x)/x is equivalent to that, for y > 0, 

h'(x + v) h'(x) ,,, , , ,, // . 

— ^ — > ^ xh'(x + y)-(x + y)h'(x) > 

x + y x 

■t==^> x(h'(x + y)- h'(x)) > yh'(x) 

rx+y rx 

<^x h"(t)dt >y h"(t)dt. 

Jx Jo 

The last inequality holds because 

rx+y rx 

x / h"{t)dt > xyh"(x) >y h"(t)dt. 

Jx Jo 

We prove that h'(x)/x is unbounded. Since h" is increasing and unbounded, 
for any C > 0, there exists D > such that 

h"(x) > C for x > D. 

Then 

f-X f-X 

h'{x)-h'(D)= h"{t)dt> Cdt = C{x-D) 

J D J D 

for x > D. Note that C is arbitrary. 

(hi) We prove that h(cx) > c 3 h(x) for c < 1. By the concavity of h", we have 

h"(cx) > ch"{x). 

Thus 

pCX f-X f-X 

h'(cx) = / ti'(t)dt = / ch"{cs)ds > / c 2 h"{s)ds = c 2 h'{x). 
Jo Jo Jo 

Hence 

f*CX f-X f-X 

h(cx)= \ h'{t)dt= / ch'{cs)ds> / c 3 h'{s)ds = c 3 h{x). 
Jo Jo Jo 

Next we prove that h(cx) < c 2 h(x) for c < 1. Since h" is increasing, h' is 
convex, thus 

h'(cx) < ch'(x) + (1 - c)/i'(0). 



Then 

pCX pX 

h(cx) = / h'(t)dt = / ch'(cs)ds < c 2 h'(x). 
Jo J a 

The case of c > 1 is obtained from the first case by replacing c and cx by 
1/c and x, respectively. 

(iv) By the proof of (ii), for any C > 0, there exists D > such that 

h'(x) >C(x-D) + h'(D) 

for x > D. Then 



h{x) 



pX pX 

- h{D) = / h'(t)dt > / (h'(D) + C(t - D))dt 

JD JD 

=h'(D)(x - D) + C(x2 ~ jP) - CD(x - D). 



Since C is arbitrary, x 2 = o(h(x)). 

(v) By the inequality of (iv), for x > 1, 



1\ 3 ,_ . (I 



r/ h(x)<h^--xj=h(l). 
Then h(x) < h(l)x 3 for x > 1. 

(vi) Writing y = c and b — x, by (iii) for any 6 > we have 

h(by) . , o fy 3 if < y < 1 

-^>min(y 2 ,y 3 )-^ 2 

[y^ ify>l- 

Hence 

It is easy to check numerically that the maximum of the right-hand side is less 
than 2. □ 

2.2 A generalized Holder's inequality 

Recall that a game is called coherent if Reality can make the capital not to 
increase at any round. Intuitively the coherence means existence of a probability 
measure such that Reality moves as if her move is based on the measure. If 
h{x) — x k , then, by Holder's inequality, we expect that the coherence implies 
vU 2 < wl/ k for all n. We give a similar inequality for a general hedge h, which 
we will use later. 
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Proposition 2.2. In UFQSH with h satisfying Assumption \1.A the game is 
coherent if and only if h(-y/v^) < w n for all n. 

Proof. Consider 

g(x; M, V, W) = Mx + V{x 2 - v n ) + W(h(x) - w n ). 

Since the case v n — or w n — is trivial, we assume v n ,w n > 0. By Skeptic's 
collateral duty, if M ^ 0, then W > or V > 0. We only consider this case. 
Then g(±oo; M, V, W) — oo and g(x; M, V, W) attains minimum with respect 
to x for fixed M, V, W . The game is not coherent if and only if 

sup min g(x; M, V, W) > 
m,v,w x 

at some round n. If V > 0, then putting x — we have 

5 (0, M, V, W) = -Vv n - Ww n < 0, 

thus we ignore this case. Furthermore we can let M = because V(x 2 — v n ) + 
W(h(x) — w n ) is an even function and for any xo > 

min g(x; M, V, W) = -\M\x + V(x 2 Q - v n ) + W(h(x ) - w n ). 

X — ±Xq 

Now write 

g(x; 0, V, W) = W x (h{x) - w n - U{x 2 - v n )) = Wf{x; U), 

where U = — V/W > 0. The game is not coherent if and only if 

sup min /fx; U) > 
u>o x>0 

for some n. For x > 

f'(x; U) = h\x) - 2Ux = M^r- - U). 
Hence for given U, the solution x = x(U) of f'(x) = is uniquely given by 



and / takes the unique minimum at x — x(U). Now the right-hand side of 
([3]) is strictly increasing in x. Hence x(U) is strictly increasing in U. By the 
assumption on h, x = x(U) is differentiable in U. Also note x(0) = 0, x(oo) = oo. 
Let 

f(U) = f(x(U); U) = h(x{U)) -w n - U(x(U) 2 - v n ). 
We now maximize f(U). Differentiating f(U) we have 

f'(U) = h'(x(U))x'{U) -Ux (2x(U)x'(U)) - (x{U) 2 - v n ) 
= [h'(x(U)) - 2Ux(U)]x'(U) - (x(U) 2 - v n ) 
- -(x{U) 2 -v n ). 



7 



This implies that / takes the unique maximum at U = U* satisfying x(U*) 2 = 
v n . By substituting x(U*) 2 — v n we have 

maxmin/O; U) = f{U*) = h(x{U*)) - w n - U*{x(U*) 2 - v n ) = h{^) - w n . 

U>0 x>0 

Hence the game is not coherent if and only if h(^fv^) — w n > for some n. □ 
2.3 Examples of the stronger hedge 

We give concrete examples of the stronger hedge satisfying the conditions in 
Corollary 11.51 



Example 2.3. Let h(x) — \x\ a for 2 < a < 3. Then h satisfies Assumption ] 1 . 3\ 
and the condition |T]). 

Example 2.4. More elaborate example is the following hedge: 

h(x) = (1 + x) 2 ln 2 (l +x) -x 2 . 
Note that h(x) = x 2 In 2 x(l + o(x)) as x — > oo and 



y L 



< 00. 



h{\/ n l l n Inn) 

This follows from the fact that for large C the following integral converges: 

1 



C (x/ In In a:) ln 2 (x/ In In a:) 



dx < 



Differentiating h(x) successively we have 

h\x) = 2(1 + x) ln 2 (l + x)+ 2(1 + x) ln(l + x) - 2x, 
h"(x) = 21n 2 (l + ir) + 61n(l + 2;), 
41n(l+x) 6 



h"'(x) = 
h""{x) = - 



1 + X X ' 

41n(l + x) 2 



(1 + x) 2 1 + x 



Hence h € C 2 , h(0) = h'(0) = h"(0) = and h" is strictly increasing, un- 
bounded and concave. 

2.4 Upper bound (validity) 

We show the upper bound of the LIL under our assumptions. 

Proposition 2.5. In UFQSH with h satisfying Assumvtion \1.A Skeptic can 
force 

[ A n — !• oo and , ^" ; < oo ) limsup " < 1. (4) 

I 4" MM / n^J V2 A n In In A, - V ' 
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By Theorem II .21 it suffices to show the following lemma. 
Lemma 2.6. In UFQSH with h satisfying Assumvtion M.SX Skeptic can force 

A n -> oo and — ^ < oo =£• |as n | = o(6„). (5) 

Proof. We consider the strategy with 

/Co = D, M„ = V n =0,W n ' 



h(eb n ) 



as long as Skeptic can keep JC n non-negative where e > is small and D is suf- 
ficiently large. More precisely, we adopt a strategy combining accounts starting 
with D = 1,2,3,... as in Miyabe and Takemura [5]. We show that this strategy 
forces ([5]). 

The capital process is 

h(xi) 



h(ebi) > e 3 b< 



^h(ebi) f^Hebi) 

By Proposition we have 



for all i. Then 

i:jxi|>ebi 1=1 



1 " 

>/C + #{1 < * < n : \x z \ > ebi} - - ^ ■ 



For a large D, the strategy keeps K. n non-negative. Hence Skeptic can force that 

#{1 < i < n : \ Xi \ > eb,} 
is finite for each e. □ 

2.5 Lower bound (sharpness) 

Next we show the lower bound of the LIL under the same assumptions. 

Proposition 2.7. In UFQSH with h satisfying Assumption \1.HA Skeptic can 
force 



(A-, — > oo and , " . < oo ) =>■ lim sup 
^h(b n ) J 



S " > 1- (6) 



\/2A n In In A n 
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For our proof of the lower bound we closely follow the line of argument in 
Section 5.3 of Shafer and Vovk [8]. Compared to Section 5.3 of Shafer and Vovk 
[5] we will explicitly consider rounds before appropriate stopping times. Also 
we will be more explicit in choosing e's and <5's. 

We assume that a sufficiently small e > is chosen first and fixed. For 
definiteness we let e < 1/8. We choose e* = e*(e) > sufficiently small 
compared to e, choose 5 = S(e, e*) > sufficiently small, and finally choose 
C = C(e, e*, S) > sufficiently large. 

More explicitly, i) e* has to satisfy (f2~Tj) below, ii) 6 has to satisfy (fTU]) . (fTTj) , 
fT5]). (HI]), ([15]), UTS]), (gDJ), (EU), (ESD below, and hi) C has to satisfy JTSJ, l[2D|l. 
?5]) below. 
Let k be such that 

/21nlnC 

K < 



c 

Define stopping time ti,T2, T3 by 



Tl=min n| ^ >52 hThTc' Wi> ^ Vinilc 



or]>>>^( J-Sj— lnlnC , 



t 2 = min{n | A n > C}, 



C 

T3 = min ■( n \ \x n \ > S 



lnlnC 



2.5.1 Approximations 

Lemma 2.8. In UFQSH with h satisfying Assumption ] 1 . 3i there exists a mar- 
tingale C n — C^' K such that £(□) = 1 and 

< (InC) 45 (7) 



exp(K<S„ — k 2 C/2) 

for n such that n = t 2 < T\ , T3 . Furthermore C n is positive and 

r 



exp( K 5„ - (1 - 8)^A n /2) 
for n < ri,T2,r 3 . 

Proof. Consider the martingale C satisfying £(□) = 1 and 

1 i i h(xi) 
r _ r 1 + KXi + ~~2 ^(k- 1 ) 



<(lnC) 4A (8) 



1 + 



2 ^(ft- 1 ) 
for all i. 
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We show that C„ is positive for n < tx,t§. First we prove that 

i + ^i- Uh >o 

2 hin- 1 ) 

Note that 



V2 V lnlnC 
Then 



V lnlnC / 2V2 \VlnlnC 



For i < n, we have 



<<5/T r 



lnlnC 



Then 



and 



Hence 



C \ to, 

> 



2^ y V In In C y ~ 2\/2 
< < 1. 



2 ' hi*,- 1 ) " * ^(k" 1 ) 



1 + 



Next we prove that 



1 + ^ + ^-mH >0 



for i < ti,t 3 . For z < r 3 , we have 



Then 

ft (a*) = ft(K3fi ■ k,- 1 ) < \nx l \ 2 h(K^ 1 ) < 2S 2 h(n- 1 ). 
Next we show the inequality © for this £„ . We claim that 

„ K X; h(Xi) 

1 + KXi + __L _ y> < e -.. 
2 /i(/t i ) 

for all i. If KXi > 0, then this inequality clearly holds. If KXi < — 1, then 

1 + KXi < 
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and 

h(xi) = h(n~ l KXi) > \nxi\ h(K~ ), 
thus the left-hand side of ([12"]) is non-positive. If — 1 < KXi < 0, then 

h(Xi) = h^^ 1 KXi) > |K2li| 3 /l(K _1 ), 

thus 

2 2 ht ( '-r -\ fe-^T 1 ^ if- 3 ,y>3 

1 + Kii + — i - — ^ < 1 + Ka* + — - — < e KX \ 
2 n(K L ) 2 6 

Then 

n n 

Y[(l + KXi + K 2 x 2 l /2-h{x, i )/h{K- 1 )) <J\e KX =e KS ". 

1=1 i=l 

Note that 

< t < S =>> ln(l +t) > (1- S)t 

and 

< t < 5 => ln(l -t)> -(1 + <J)f 
for sufficiently small 5. Note that Wi/h^^ 1 ) < 5 for i < n < t\ and 

k 2 v, 2 In In C r2 C* 1 c2 

< • 5 = 6 . 

2 - C lnlnC2 

Then if 

2 

^-W^hiK- 1 ) > 0, 

we have 

in(i + ^ - > (i - - (i - *Wfc(« -1 )- 

On the other hand, if 

2 

- Wi/h{K- X ) < 0, 

then 

ln(l + ^1 - > (1 + 5)^ - (1 + S)w i /h(K- 1 ). 

Combined with them, we have 

2 2 

ln(l + ^ - Wi/hin- 1 )) > (1 - (5)^ - (1 + Qwi/hiK- 1 ). 

Thus 

53 ln(l + ^ - > E «< - (i + w*- 1 ) E ' 

i— 1 i=l z—1 
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and 

(l-tf)^ « (1 + (5) 



in£„ < K 5„ - v / + k^ryE 



U'j 



i=l 



By the inequality ©, we have 



kin- 1 ) > J—h ( 



2y/2 IV lnlnC 
Hence 



i=l 

for n < T\. Thus 



^lOi < Sh I J — ] lnlnC < 2\/2^(K" 1 )lnlnC 



In £„ < K^n - y~ Y, v * + 2^2(5(1 + 6) In In C 

i=l 

(1 — S)k 2 

< KS n - - Y~ A n + 45 In In C 

for sufficiently small 5 such that 

2\/2(l + £)<3. (15) 

Hence ([8]) is proved. 

The inequality above also implies ([7]) because, for n — T2, 

ln£„ - K 5„ + ^ <^ - (l-5h 2 C + 2 ^ (1 + 6) lnlnC , 

<<5 In In C + 2\/25(l + <5) In In C 
<4<51nln C. 



□ 

Lemma 2.9. in UFQSH with h satisfying Assumption l 1 . 31 there exists a posi- 
tive martingale C n — C- ,K such that £(□) = 1, 

-AS 



exp(K<S„ — k 2 C/2) 

for n such that n — T2 < Ti , T3 . Furthermore for n < Ti , T2, T3 

r 



>(lnC)- 4fl (16) 



exp(«;5 n - (1 + <5)k 2 A„/2) 



> I- (17) 



The proof is the same as Lemma 5.2 in Shafer and Vovk [8], except that we 
also explicitly consider n < ti. 
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Proof. Let 



/(f) = l+f +(! + *)- 



and consider the martingale C satisfying £(□) = 1 and 

r _ r l + KX t + (l+S)K 2 X 2 j2 _ f(KXi) 



l + K 2 Vi/2 l + (l + 5)n 2 v t /2 

for all i. For i < T3, 



Since 

f 2 

|f| < V25=^ l + f+(l + 5)- > e *, 
for sufficiently small (5 we have 

n n 

n/(^)>ii eKa;i = eK5 "- 

i=l i=l 

Since ln(l + f) < f, 

n 2 n 2 

EMi + (i + ^)<(i + *)£^. 

It follows that 

K 2 -A K 2 

ln£„ > - (l + ^2]^ = - (l + 5)—A n . 

Hence (fTB]) is proved. 

The last inequality implies ([TTf because, for n = r 2 , 



5 C-(l + 5)-5< 



2 v '2 lnlnC 

> -JlnhiC- (l + 5)5 2 

> - 45 In In C 



for sufficiently large C such that 

3 In In C >5(l + 5). 
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2.5.2 Construction of a martingale 

Lemma 2.10. Choose C sufficiently large for a given e. In UFQSH with h 
satisfying Assumption ] 1 . 31 there exists a martingale Af such that 

(i) Af(n) = i, 

(ii) For n such that n = Ti < t\ , T3 and 



S n <(l- e)%/2C*lnlnC, 

we have 

M n > 1 + 



InC 

(iii) M n is positive for n < t\ , t-i , T3 . 

Proof. Choose e* and (5 sufficiently small and C sufficiently large. Let 



/21nlnC , , . 

Ki = (l-e)y — , k 2 = (1 + e )ki, K3 = (l + e)K 2 . 

Define a martingale M. n by 

where £^ ,K is the martingale bounded from above in Lemma [2.81 and C^' K is 
the martingale bounded from below in Lemma 12.91 Furthermore define Af n by 

At-l l ~ M " 



InC 



Since M(D) = 1, Af(D) = 1. 

First we prove that M n < for n = r 2 < T\ , t 3 and < (1 — e)V2Cln InC. 
The value M n bounded from above by 

< 3exp((l + e*)Ki5 n - (1 + e*) 2 K 2 C/2)(ln C) iS 

- exp(K 1 5„ - nlC/2){\nCy iS 
= exp(Ki<S„ - K 2 1 C/2)(\nC)- iS 

x (3exp(e*K 1 S n -e*(2 + e*) K 2 1 C/2)(lnC) ss - 1). 

This is negative because 

e*K 1 5„ - e*(2 + e*)n 2 C/2 <e*(l - e) 2 21nlnC - e*(2 + e*)(l - e) 2 lnlnC 

< - (e*) 2 (l-e) 2 mlnC 
<-ln3-851nlnC 
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for sufficiently small S and sufficiently large C such that 

8<5<i(0 2 (l-e) 2 , i( e *) 2 (l-e) 2 lnlnC>ln3. (20) 

Next we prove that Af n is positive for n < min(Ti, T2) < T3. We distinguish 
two cases depending on the value of S n . Consider the case that 

55 In In C 
S n < n 3 A n H — . 

Then by Lemma l2~8l 

ln£p 2 < K 2 S n - (l-5)^A n + 45lnlnC 

, A 5<51nlnC\ . „ x , , ri , „ 

< K 2 {K 3 A n + — - 1 - S)^-A n + AS In In C 

= ^-A n (2(l + e*) - (1 - 5)) + i±^4<51nlnC 

= l -^A n (l + e *) 2 (l + 2e* + S)(l ef + ^±if^lnlnC 

< ((1 + e*) 2 (l + 2e* + S)(l - ef + lnlnC < lnlnC. 
We can assume that 

(1 + e*) 2 (l + 2e* + <5)(1 - ef + ^P~S < 1. (21) 

Hence writing c e = (1 + e*) 2 (l + 2e* + S)(l - ef + S(5 + Ae*)/e* < 1 we have 
r<,K 2 

< (In Cf'- 1 ^ (C -> 00) (22) 

In G 

and in this case Af n is positive for large C. 

Now consider the other case S n > n^A n + 5<51nlnC/(K2e*). Then 

r<-n2 K 2 2 

In -2— < « 2 5„ - (1 - S)^-A n + AS In In C - ( K3 5 n - (1 + <5)^A„) 

= (Ka - « 3 )5 n + ^ (C 1 + - (! - ^a) + 45 In In C 

K 2 

= -e*K 2 S n + -j-A n {{\ + S)(1 + e*f - (1 - (5)) + AS In In C 

*\ ? ,. 5<51nlnC\ 
< -e*((l + e*)«iAi + ) 

+ + J)(l + e*) 2 - (1 - 5)) + 451nlnC 

= ^-A n ( - 2e*(l + e*) + (1 + e*f - 1 + S((l + e* f + 1)) - JlnlnC 

= ^-A n ( - (e*f + 5((l + e*f + 1)) - 5 In In C < 
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for S such that 

-(e*) 2 +<5((l + e*) 2 + l)) <0. (23) 

In this case 



§—< (In <?)-*-> (C^co) (24) 



r<,K 2 
C 

and Af n is positive for large C. 

Hence at round n < min(ri,T2) < T3, Af n is positive for large C in both 
cases. 

We finally consider the case n — r 3 < r x , r 2 . The difficulty with the stopping 
time T3 is that it depends on Reality's move x n , thus it is after Skeptic uses the 
strategy that Skeptic know whether n — r 3 . We need to make sure that JV n is 
positive even if Reality has chosen a very large \x n \ at the round n. By (vi) of 
Proposition 12.11 

n 2 x 2 h(xi) y 2 h(by) , , 

Hence for all and k > 

k 2 x 2 h(xi) 

and the relative growth of C^' K2 is bounded by 3 from above. Hence at n = 

T 3 < Tl , T 2 

J ~n — oi -n-l ■ 

Also for all Xi and n > 

l.- 2 ™ 2 2 2 1 

1 + KXi + (1 + <J)-^- > 1 + KXi + > - 

Hence the relative growth of C^' K3 is bounded by 1/3 from below. Hence at 

n = T3 < Tl , T2 



< 9 X 



l~, n L 'n-l 

Then A/" n is positive at n = T3 < Ti, T2. by choosing C large enough in (|22|) and 



24|) such that 

(lnC)^ 1 < 1/3 and (lnC*)" 15 < 1/9. (25) 

□ 



2.5.3 Strategy forcing the lower bound 

Here we discuss Skeptic's strategy forcing the lower bound in Proposition 12.71 
For each sufficiently small e > 0, we want to construct a positive capital process 
K. n such lim sup n K. n — 00 for any path satisfying the antecedent in and 

S n < (l-2e) A /2A„lnlnA l (26) 
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for all sufficiently large A n . We also assume that Skeptic is already employing 
a strategy forcing the upper bound in LIL for — S n with a small initial capital. 
Hence S n > — (1 + e)y/2A n In In A n for all sufficiently large A n . For a path 
satisfying the antecedent in © and the inequality in (j2"o| . at the round n' with 
A n i = (D + l)A n we have 

Sn' < (1 - 2e)y/2(D + l)A n lnln(£> + l)A n . 

Then 

SW - S n < (1 - 2e)\/2ZM n lnlnZM n + (1 + e) a/2A^ In In A n 

Let D = 1/e 4 . Recall that we assumed e < 1/8 for dcfinitcncss. For this 
Z? = 1/e 4 it is easily seen that for all sufficiently large A n we have 

(1 - 2e)y/2(D + l)A n lnln(£> + l)A n + (1 + e)y/2A n In In A n 
< (1 - e)V2L>A„lnlnDA„ 

and 

- S„ < (1 - e)V2Z?A„ lnlnD^n. 

Now, if necessary, we increase D to D = max(C, 1/e 4 ), where C is taken suffi- 
ciently large to satisfy requirements ((fT9|). (|20|) . (|25|) ) in the previous sections. 

Now we consider the following strategy based on the strategy of Lemma B.lOl 
with C replaced by D k where k € N. 

Start with initial capital JC = 1. 
Set k = 1. 

Do the followings repeatedly: 
C:=D k . 

Apply the strategy in Lemma [2.101 until 

or E2=i > ^ (VeEt) lnlnC '' 

(ii) ^4„ > C, 
or 

(iii) | a: n | > Sy/C] lnlnC, 

Set fc = max{fc + 1, min{m : D m > A n }}. 

The "until" command is understood exclusively for (i), but inclusively (ii) 
and (iii). If (i) happens, Skeptic does not apply the strategy of Lemma [2.101 
and let = M n =Vn = W n . He increases k (and C) so that (i) does not hold 
(such k always exists) and Skeptic can apply the strategy for the increased C. If 
(ii) happens, Skeptic continues to apply the strategy and go to the next k after 
that. Note that, Skeptic can observe whether (i) or (ii) happened or not before 
his move, because (i) and (ii) only depend on Forecaster's move, but he knows 
whether (iii) happens or not only after Skeptic applied a strategy, so "until" 
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command should be inclusive for (iii). This point was already discussed at the 
end of our proof of Lemma 12.101 

Suppose that the path satisfies the antecedent in © and the inequality in 
Since A n — > oo, k will go indefinitely by (ii). 

First we claim that 

a 

v n = o(bl), w„ = o(b n ) and J~]wj = o(h(b n )). 

i=i 

The second formula follows from J2 n Wn /h(bn) < oo and the third formula 
follows from ^ n w n /h(b n ) < oo and Kronecker's lemma. We show that 

v n = o(b 2 n ). 

Suppose otherwise. Then, for some c such that < c < 1, 

> c 



K 

for infinitely many n. Since h(cx)/h(x) > c 3 , 

HV^) > M C M > c 3 

h(b n ) ~ h(b n ) ~ 
for infinitely many n, which contradicts the fact that 

h(y/v^) <w n = o{h(b n )) 



by Proposition 12.21 

We claim that (i) and (iii) happen only finitely many times. Consider the 
case that k is sufficiently large. Then n is large, thus, by the fact showed above, 
we have 



8 2 2 5 6 . . . 5 I ~K~ n 

v n < —b n , w n < -b n , 2_^ w i < -jhybn) and M < 2 V In In A ' ' ' 

If A n > C, then j4„_i < C. Then, in any case, 

S 2 A 

A n = A n -1 + V„ <C+ — - " < 5 A n , 

2 lnmA n 

which implies 

C>(l-S)An. 
Since A n is sufficiently large too, 



b n _ 1 / A n < J (1 - 5)A 



2 2VlnlnA n V lnln(l - <5)A„ ' 
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thus, by (|2"7|) . we have 



i—l 

Hence (i) and (iii) do not happen when k is sufficiently large. 

Note that k is set to be k + 1 at all but finitely many times. As we showed 
above, we have 

D k = C>(l-S)A n , 

thus 

D k+1 > (l-8)DA n >A n . 
Hence from some k on (ii) always happens and 



x i ^ 0- - e)V2ClnlnC 



i=l 



will be satisfied. Then limsup^/Cn = oo because 



lnD k J *- L \ klnD 

k v / k x 

This completes the proof of Proposition 12.71 
2.6 Proof of the corollary 

Finally we give a proof of Corollary 11.51 First we give the definition of compli- 
ance. 

Definition 2.11 (Miyabe and Takemura [5]). By a strategy 7Z, Reality complies 
with the event E if 

(i) irrespective of the moves of Forecaster and Skeptic, both observing their 
collateral duties, E happens, and 

(ii) sup„ Kn < oo . 

Theorem 2.12 (Miyabe and Takemura :5J. In the unbounded forecasting, if 
Skeptic can force an event E, then Reality complies with E. 

This theorem also holds for UFQSH by essentially the same proof. 

Proof of Corollarv \1.5\ The implication of (i)=>(ii) immediately follows from 
the main result. The implication of (ii)=>(iii) follows from the result above. 

Let us show (iii)=>(i). Consider the case that Skeptic uses the strategy with 
which he can force 

limsup ^ n m = = y/v, (28) 
n-s-oo V2nlnlnn 

and that Reality uses the strategy with which she can comply with ([2]). Then 
both © and (|2"5)l hold for the realized path {x n }. This implies (i). □ 
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Discussion 



We gave a sufficient condition for the law of the iterated logarithm in game- 
theoretic probability with quadratic and stronger hedges. The main difference 
from the result in Shafer and Vovk [5] is that we could show the lower bound 
(sharpness) in a non-predictable protocol. The assumption of the stronger hedge 
is strong enough to imply the result which has a similar form as Hartman- 
Wintner's LIL and Strassen's converse. 

However the condition ([TJ says that there should be a gap between quadratic 
hedge and the stronger hedge. The authors do not know whether the condition 
can be weakened so that the hedge is as close to quadratic one as one wants. The 
authors also would like to know other formulations of i.i.d. in game-theoretic 
probability. 
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